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Several dynamic modulus (E*) predictive models of asphalt 
mixtures have been developed as an alternative to laboratory 
testing. The 1999 I-37A Witczak equation is one of the most 
commonly used alternatives. This equation is based on 
mixtures laboratory results in the U.S. In Latin American 
countries there are significant differences in material 
properties, traffic information, and environmental conditions 
compared to the U.S.; therefore, there is a limitation is the 
use of this equation using local conditions. The National 
Laboratory of Materials and Structural Models at the 
University of Costa Rica (Lanamme UCR) has previously 
performed a local calibration of this equation based on 
results from different types of Costa Rican mixtures. 
However, there was still room for improvement using 
advanced regression techniques such as_ neural networks 
(NN). The objective of this study was to develop an 
improved and more effective dynamic modulus regression 
model for mixtures in Costa Rica using Neural Networks. 
Results indicated that the new and improved model based on 
neural networks (E* NN-model) not only met the model 
adequacy checking criteria but also exhibited the best 
goodness of fit parameters and the lowest overall bias. 


1. Introduction 


The most important asphalt concrete mixture property influencing the structural response of a 
flexible pavement is the dynamic modulus (E*). For a specific mixture, temperature, rate of 
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loading and aging significantly influence this property. E* is also the primary hot-mix asphalt 
(HMA) material property input at all three hierarchical levels in the new AASHTOware 
Pavement ME Design Guide or formerly known as mechanistic empirical pavement design guide 
(MEPDG) [1]. 


Various E* predictive models have been developed to estimate E* as an alternative to laboratory 
testing. The most widely used model is the 1999 I-37A Witczak predictive model based on 
conventional multivariate regression analysis of laboratory test data. Because of this, the Witczak 
model has been evaluated using many different datasets and has been calibrated to several 
regions. However, use of the model with no calibration for local mixtures should be limited. 


The results of a study conducted at MnROAD indicated that the Witczak predictive equation 
fitted the data relatively well in some locations at intermediate and low temperatures, but for 
other locations the differences were significant [2]. The authors concluded that the Witczak 
equation should be used with caution and they also recommended further research to adjust and 
validate this equation for mixtures and local conditions found in Minnesota. 


A study at the University of Florida [3], evaluated the same equation using 28 mixtures from 
Florida. The results of this study indicated that the Witczak equation was slightly bias for the 
mixtures investigated. The results also allowed the correction of the bias between predicted and 
measured E* by means of statistical calibration. Authors also found that E* predicted values at 
higher temperatures generally were closer to measured values than predictions at lower 
temperatures. Authors pointed out that the database used to develop the Witczak model could be 
constrained to predicting the modulus of mixtures tested at higher temperatures. 


41 mixtures commonly used in North Carolina were used to evaluate the prediction accuracy of 
the Witczak equation and the influence of some mixture variables in the prediction of E* [4]. The 
study showed that Witczak’s predictions for cooler temperatures were better than at warmer 
temperatures. This is the opposite of what was observed in Florida and thus highlights the 
importance of proper calibration. 


Another study by Schwartz in 2005 [5] evaluated the accuracy and robustness of the Witczak 
predictive equation through a set of sensitivity and validation analyses. The same database used 
to create the Witczak equation and an independent set of laboratory E* test data for 26 other 
mixtures were used for calibration purposes. The validation analysis of the Witczak equation 
against the independent set of data showed a good match between predicted and measured E* 
values that was nearly as good as for the calibration data set, but with a slight positive bias which 
was higher for lower stiffness/higher temperature conditions. 


The University of Arkansas studied 12 commonly used mixtures in Arkansas and found a good 
correlation between Witczak predicted E* values and laboratory measured results [6]. The 
goodness-of-fit statistics showed that the prediction of E* for the mixtures used in the study 
ranged from very good to excellent, according to the subjective criteria used. 


Robbins and Timm in 2011 [7], evaluated three E* predictive models (Witczak 1-37A, Witczak 
1-40D, and Hirsch) with using 18 plant-produced, lab-compacted mixtures. These mixtures were 
placed at the 2006 National Center for Asphalt Technology Test Track. The Hirsch model for 
estimating asphalt mixture modulus is based on a law of mixtures for composite materials [8] 
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which utilizes the shear modulus of the binder, G*, and volumetric properties of the mix to 
predict E*. E* estimaded values were obtained at three temperatures and three frequencies for 
direct comparison with laboratory measured results. Results indicated that the Witczak equation 
had the greatest deviation from measured values, and the Witczak 1-40D model overestimated 
E* values by approximately 61%. The Hirsch model most accurately predicted the moduli for the 
2006 Test Track mixtures. 


Singh et al. in 2011 [9], also evaluated the Witczak equation for estimating the dynamic modulus 
of selected asphalt mixtures commonly used in Oklahoma. Analyses of the results indicated that 
a calibration factor was needed for the model to obtain an accurate estimates of dynamic 
modulus. El-Badawy et al. in 2012 [10], also indicated that the accuracy of this equation can be 
further enhanced by adding a local calibration factor. 


In the case of Costa Rica, a similar analysis was performed to ensure that the Witczak model 
could be readily applied to local mixtures [11]. The Witczak model was identified to produce 
slightly biased predictions of E* when compared to several gradations, mostly of typical use in 
the country. As was the case with some of the previous studies, the model showed positive bias at 
higher stiffness/lower temperature conditions. Consequently, a calibrated Witczak model was 
fitted using nonlinear regression. 


Far et al. in 2009 [12], developed a new, rational, and effective set of dynamic modulus E* 
predictive models. These predictive models used artificial neural networks (ANNs) trained with 
the same set of parameters used in the Witczak equation. E* values from several mixtures were 
collected from existing national efforts and from data obtained at North Carolina State 
University. The results showed that the predicted and measured E* values were in close 
agreement when ANN models were used. 


A paper presented by Ceylan et al. in 2009 [13], discussed the accuracy and robustness of the 
various models including an ANN based models. The ANN-based E* models showed 
significantly better overall prediction accuracy, better local accuracy at high and low temperature 
extremes, less prediction bias, and better balance between temperature and mixture influences 
compared to the ordinary least squares (OLS) regression-based approach. Authors indicated that 
the ANN models were better able to rank mixtures in the same order as measured E* for fixed 
environmental and design traffic conditions. 


In summary, the I-37A Witczak predictive model has worked well in some cases and not so well 
in others. Calibration of this equation has also been implemented by several researchers while 
others decided to utilize the 2006 Witczak model or decided to adopt a different approach such as 
the Hirsh model. Finally, the use of more advanced regression techniques has also proven to be a 
more attractive alternative to calibration of the Witczak equation. 


2. Objective 


The objective of this study was to create a neural network (NN) based models to improved 
accuracy and reduce bias in the prediction of dynamic modulus (E*) for asphalt mixtures in 
Costa Rica. 
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3. Mixture characterization and evaluation 


In 2011, LanammeUCR conducted a laboratory evaluation of the applicability of the Witczak 
Model to a typical aggregate source and one type of asphalt binder produced in Costa Rica [11]. 
The flow chart presented in Figure 1 summarizes the experimental plan of the study, where 10 
different gradations were selected using one aggregate source and specimens were compacted 
using the Superpave gyratory compactor. 


The study involved one aggregate source (from a northeast region of the country called 
Guapiles). The aggregate is extruded from igneous deposits along a river. The aggregate 
properties are shown in Table 1. 


In Costa Rica only one type of asphalt is produced. The binder viscosity classification 
corresponds to an unmodified AC-30. Based on the Superpave specification, the binder classifies 
as a PG64-22. The properties for the asphalt binder are shown in Table 2. 


Dynamic modulus 
asphalt mixtures 


Characterization of 
Component Material 


Asphalt AC- Aggregate 
30 
1 source 


10 Gradations | 


3 Gradations 2 Gradations in 2 Gradations 1 Plant SMA ee : 
below the PZ* thru the PZ* above the PZ* Gradation Microsurfacing mix 
Gradation 

Design 4% air 

voids 
Dynamic Modulus 
Test 
; Specimens avast 
30 gyrations of compacted with 80 gyrations of 
SGC 7% air voids SGC 
Lab Modulus Modulus of 
Results Witczak Model 
| 
Statistical 


comparison of results 


PZ*: “prevention zone” or SUPERPAVE’s restricted zone 


Fig. 1. Flow Chart for the Experimental Plan. 


EF. Leiva-Villacorta, A. Vargas-Nordcbeck/ Journal of Soft Computing in Civil Engineering 3-2 (2019) 01-15 


Table 1 
Physical Properties of the Aggregates Used in the Study. 
Property Test Method Value Unit Specifications 
Coarse Aggregate 
L.A. Abrasion AASHTO T 96 21.21 % 37% max. 
Specific Gravity AASHTO T 85 2.652 2.85 max.! 
Absorption AASHTO T 85 1.69 % 4% max." 
Faces Fractured 100 % 90% min.” 
1 face ASTM D 5821 
2 or more 99.8 % 75% min.” 
Fine Aggregate 

Plasticity index AASHTO T 90 NP 10% max.! 
Sand equivalent AASHTO T 176 78 - 
Angularity AASHTO TP 304 37.2 % - 
Specific Gravity AASHTO T 84 2.549 2.85% max. 
Absorption AASHTO T 84 3.283 % - 
"Nevada DOT Standard Specifications for Road and Bridge Construction, 2001. 


> Standard Specifications for Constructions of Roads and Bridges on Federal Highways Projects, FP-03 


Table 2 

Physical Properties of the Used Asphalt Binder. 
Aging State Property 

Density at 25°C 


g/em? 


Asphalt Binder AC-30 


5 


Absolute viscosity at 60°C 


Poise 


Kinematic viscosity at 125°C 


centiPoise 


Original | Kinematic viscosity at 135°C 


centiPoise 


Kinematic viscosity at 145°C 


VTS, regression slope of viscosity temperature susceptibility 


centiPoise 


Regression intercept - 10.26 
Absolute viscosity at 60°C Poise 11512 
RTFO Kinematic viscosity at 125°C centiPoise 1712 
Kinematic viscosity at 135°C centiPoise 938 
Kinematic viscosity at 145°C centiPoise 550 


3.1. E* specimen preparation 


Ten different types of asphalt mixtures were designed in the laboratory. Three dense graded 
mixtures (G1, G2 and G3) below the “prevention zone” (also called Superpave’s restricted zone); 
two dense graded mixtures (G6 and G7) above the “prevention zone”; two dense graded mixtures 
(G4 and G5) thru the “prevention zone”; one Stone Matrix Asphalt (SMA) mixture (G9); one 
micro surface asphalt mixture (G8), and a typical plant dense graded mixture (G10). The 
gradations are presented in Table 3. The design air void content was fixed to 4%. Two mixture 
design methodologies were used: Marshall and Superpave. The optimum asphalt content by dry 
weight of aggregate (DWA) and by total weight of mixture (TWM), voids in the mineral 
aggregate (VMA), the voids filled with asphalt (VFA), and the effective asphalt content (Pbe) 


based on both methodologies are shown in Table 4. 
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Table 3 
Studied Aggregate Gradations. 
Studied Gradation 
Thru the Above the 
prevention zone prevention zone 


Below the prevention zone 


G2 
100 
100 
95 
62 
33 
23 
16 
12 
9 
7 


Table 4 
Summary Volumetric Properties of the Mix for All the Aggregate Gradations Studied. 
Description Gradation | Mix design Pb (DWA) |Pb (TWM) 
Superpave 
Marshall 
Below the Superpave 
prevention zone Marshall 
Superpave 
Marshall 
Superpave 
Thru the Marshall 
prevention zone Superpave 
Marshall 
Superpave 
Above the Marshall 
prevention zone Superpave 
Marshall 
Superpave 
Marshall 
Superpave 
Marshall 
Superpave 
Marshall 


Micro surfacing 


4. Dynamic modulus of asphalt mixtures 


In order to evaluate the dynamic modulus of the different mixes, all specimens were prepared 
following the standard method ASTM D3496 “Practice for Preparation of Bituminous 
Specimens for Dynamic Modulus Testing”. The testing was performed according to ASTM 
D3497 “Standard Test Method for Dynamic Modulus of Asphalt Mixtures” and AASHTO T 62 
"Determining Dynamic Modulus of Hot Mix Asphalt". 
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The experimental design included four factors; the first factor was the gradation with the ten 
levels (G1, G2, G3, G4, G5, G6, G7, G8, G9 and G10), the second factor was the temperature 
with five levels (-5, 5, 20, 40 and 55°C), the third factor was the loading frequency with six 
levels (0.1, 0.5, 1, 5, 10 and 25 Hz), and the fourth factor was the compaction effort with three 
levels (30 gyrations of the Superpave gyratory compactor (SGC), 80 gyrations of SGC, and 
specimens compacted with 7% air voids). 


4.1. Master curves 


The master curves and the corresponding shift factors were developed directly from the dynamic 
modulus tests. Microsoft Excel Solver was used to optimize the calibration coefficients. It 
involved nonlinear optimization using the sigmoidal function shown in Equations | and 2. Both 
equations describe the time dependency of the modulus. As summary of the regression 
parameters is shown in Table 5 and Figure 2 shows the Dynamic Modulus Master Curves of all 
10 gradations used in the study. 


Log|B\=5-+- i (1) 


14 eh trost,) 

where, 

E*= dynamic modulus. 

t, = time of loading at the reference temperature. 

0, @ = estimated parameters; for a given set of data, 6 represents the minimum value of E* and 
o+ a represents the maximum value of E*. 

f. y= parameters describing the shape of the sigmoidal function. 


aT) == ,  log(t,) = log(r) - logla(T)] (2) 


r 


where, 


t, = time of loading at the reference temperature. 

t = time of loading at a given temperature of interest. 
a(T) = Shift factor as a function of temperature. 

T = temperature of interest. 


Table 5 
Summary of the Fitting Parameters for the Construction of the E* Master Curves. 


Parameter 
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Fig. 2. Dynamic Modulus Master Curves for the Gradations Used in the Study. 


5. Quality of fitted Witczak model on Costa Rican mixes 


For Level 2 and Level 3 analysis of the mechanistic-empirical design guide, the master curves 
would be developed directly from the dynamic modulus Witczak I-37A predictive equation 
shown in equation 3. This equation is intended to predict E* values of asphalt mixtures over a 
wide range of temperatures, rates of loading, and aging conditions based on information that is 
readily available from material specifications or volumetric design of the mixture [1]. 


logE* = 3,750063 + 0,02932p499 — 0,001767(p99)2 — 0,002841p, — 0,058097V, 


Vb 3,871977—0,0021p4+0,003958 —0,000017 240,005470 
—0,802208 SE og SBN 77 002108 0008298 se “O0000T pan) Ft 0C0Es700s4 (3) 
VoerftVa 1+e(—0,603313—0,31335 log(f)—0,393532 log(n)) 


where: 

E* = dynamic modulus, psi, 

7 = bitumen viscosity, 106 Poise, 

f= loading frequency, Hz, 

Va = air void content, %, 

Vbeff = effective bitumen content, % by volume, 
p34 = cumulative % retained on the *% in sieve, 
p38 = cumulative % retained on the 3/8 in sieve, 
p4 = cumulative % retained on the No. 4 sieve, 
p200 = % passing the No. 200 sieve. 
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Overestimation of E* values for mixtures in Costa Rica (Figure 4) was first reported by Loria 
and his associates in 2011 [11]. The application of this model on mixtures in Costa Rica not only 
over predicted E* values but also failed to comply one of the assumptions of OLS regression and 
ANOVA: a constant variance of the error term. In the residual versus the fitted values plot, the 
errors should have constant variance when the residuals are scattered randomly around zero. In 
this case, the residuals increase or decrease with the fitted values in a pattern that looks like a 
funnel or uneven spreading of residuals across fitted values, the errors may not have constant 
variance (Figure 3). A curvilinear pattern in the residual versus fitted values plot also indicated 
that a higher-order term to has to be added model. 


40000 


8 
8 


Predicted E*, Mpa 
N 
S 
S 


Residuals - Witczak Model 
[o) 
R 


10000 4 -0.1 
@ &E* Witczak 
. -0.2 
— Equality 
0 -0.3 
0 10000 20000 30000 40000 2 3 4 5 
E* Lab, MPa Fitted Log(E*) - Witczak Model 


Fig. 3. Evaluation of the Witczak Model. 


As mentioned previously, the Witczak-Lanamme model was developed to adjust or calibrate the 
Witczak model based on the E* results of several mixtures used in Costa Rica. This new model 
was suggested based on a nonlinear approach that significantly improved the model fit 
(R?=0.9355, standard deviation of error term=1,494.4 and SSE=5.1997). The model is shown in 
Equation 4. 


log E* = 5, 535833 +.0,002087 py — 0, 000566( P99)” —0,002590 2, — 0, 078763V, 
Sees | Vie }. 2,399557 +0,000820 p, —0,013420,, + 0,000261(p,,)” +0,005470/,, 


J +. @(0:052941-0,498 163log( f)—0,691856log(7)) 


Viet + 


(4) 


The application of the Witczak-Lanamme model not only fixed the overestimation of E* values 
but also in the residual versus the fitted values plot, the errors had constant variance with the 
residuals scattered randomly around zero (Figure 4). However, further investigation showed that 
high errors were still obtained from some mixtures and the variance of the predictions was not 
uniform. Ideally, in the plot of actual E* values versus predicted ones, a small and random 
deviation from the line of equality is desired for all data points. As an attempt to reach this ideal 
scenario, the artificial neural networks (NN) methodology was implemented using the same 
dataset. 
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Fig. 4. Evaluation of the Witczak-Lanamme Model. 
6. Development of the E* - NN model 


A neural network is a massively parallel distributed processor that has a natural propensity for 
storing experimental knowledge and making it available for use [14]. Knowledge is acquired by 
the network through a learning (training) process. The strength of the interconnections between 
neurons is implemented by means of the synaptic weights used to store the knowledge. The 
learning process is a procedure of adapting the weights with a learning algorithm in order to 
capture the knowledge. In other words, the aim of the learning process is to map a given relation 
between inputs and outputs of the network. 


The learning method used to develop the NN model was a feed-forward back propagation with 
the sigmoidal function (Equation 5) as the transfer function. It was found that the two-layer 
network with 10 nodes in the hidden layer was the most appropriate for this dataset (Figure 5). 
The structure of the network is given by Equations 5 through 7. A single index indicates an array; 
dual indices represent a matrix with the first letter indicating the values in the row and the second 
letter indicating the values in the column. The index i represents the input parameters and the 
index k represents the hidden layer. 


f(T) =—-1 (5) 
Hy = Be + Lita Wik P; (6) 
Output = Ln(E*) = f (Bo + D7b1 HW) (7) 
where; 


T= placeholder variable, 

H;, = transferred value of nodes at the hidden layer, 

P; = input variables (p200, p4, 938, Va, Vober, loglog(n), temperature and frequency), 
W;;,, = weight factors for the hidden layer, 

W,.= weight factors for the output layer, 
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Bx, = bias factors for first layer, 

BO = bias factor for outer layer, 

m = number of nodes in hidden layer 
Ln(E*) = natural logarithm of E*. 


Activation process to transport 
input vector into the network 


< 
xe oy 
Rat) ) oF 
> & 
Ln(E*) 


Input Vector 
“fe 


Hidden 
Layer #1 


Backpropagation of error to 
update weights and biases 


Fig. 5. Schematic of model development process. 


6.1. Model weights and bias values 


Weight matrices and bias vectors of the NN model are shown as follows: 


Bias factors for first layer, 


Bi = [2.3134 4.0247 2.1380 —11.9793 0.3330 -— 6.3721 -—5.0298 — 0.2873 — 10.6756 10.3805] 


Weight factors for the hidden layer, 


-4.2794 23.2425 -4.0547 -12.9996 0.0060 8.4144 -3.4470 -0.0002 0.0118 13.7398 
-10.8394 -2.4254 -5.4623 4.0784 -0.0272 -2.1539 -7.4460 0.0250 0.0073 -17.2411 
7.5808 5.2567 7.6583 -22.1995 0.1250 -2.7495 0.8265 -0.1192 -0.0303 -5.5932 
W; -15.3861 26.5062 -1.7360 3.2115 0.1505 0.9341 -18.8182 -0.1521 -0.0390 -3.5607 
— 2.3739 -5.2556 8.2966 -4.0598 0.1879 3.7634 3.6738 -0.1812 -0.0185 5.0671 
-0.3161 -6.6774 -4.7862 0.2819 0.4871 1.6285 -0.4955 -0.4942 -1.8913 4.2234 
-0.1810 -14.1131 -8.9340 2.1166 1.3467 2.3166 -0.5999 -1.3313 -1.8068 2.0520 
0.0159 0.6328 0.4785 -0.1558 -0.3746 -0.1602 0.0106 0.3321 -8.0241 0.1222 


Weight factors for the output layer and bias factor for outer layer, 


0.2402 
0.0377 
0.0410 
0.0722 
6.6041 
WwW, = 0.0695 Bo = -13.6918 
-0.2727 
7.6429 
-13.6531 
0.0456 
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Relative importance based on Garson's formula indicated that all input variables can be 
considered significant to explain output variable. Temperature was found to be the most 
important input variable. This was expected since dynamic modulus of asphalt mixtures are 
highly susceptible to small changes in temperature. Relative importance results were computed 
in percentage format as follows: 


p200 14.9% 
p4 11.7% 
p38 12.3% 
Va 15.6% 
Vert 9.2% 
loglog (n) 9.1% 
temperature 17.5% 
frequency 9.8% 


Potential overfitting on the model was controlled by constraining the complexity of the model 
and by monitoring the performance of the model during training. The first one was accomplished 
by changing the network structure (number of weights). The second one was accomplished by 
evaluating performance on both a training dataset and on a holdout validation dataset. Learning 
curves will show a line for the training dataset that drops and may plateau and a line for the 
validation dataset that drops at first, then at some point begins to rise again. This was an 
indication of potential overfitting. 


As an example, if these parameters are substituted into Equations 5 through 7 with p200 = 5, p4 
= 63, p38 = 12, Va = 7.41, Vober = 5.69, loglog(n) = 3.7859, temperature = -3.4 and frequency = 
25, the predicted In(E*) value of 9.31415 and the E* value of 11,402 MPa would be calculated 
from this recommended model. 


The results of the application of the NN model on the entire E* database are shown in Figure 6. 
In the plot of actual E* values versus predicted ones, a small-constant deviation from the line of 
equality was acquired for all data points. In addition, in the residual versus the fitted values plot, 
the errors had constant variance with the residuals scattered randomly around zero. 


40000 0.4 5 
A E*-NN Model 
7 —— Equality 7 0.3 5 
& 30000 3 | 
s Ss 0.2 
x” 2 
Ww 0.1 + 
7% 20000 7 
hs * 0 
= © 
oj Ss 
3S o1 4 
= 10000 got 
© 0.2 
0 -0.3 
0 10000 20000 30000 40000 4 6 8 10 12 
E* Lab, MPa Fitted LN(E*) - NN Model 


Fig. 6. Evaluation of the E* - NN Model. 
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The slope of the measured versus predicted curve for all three models was used to perform a bias 
analysis. As shown in Figure 7 the highest deviation from the line of equality in terms of the 
slope was obtained for the Witczak I-37A model. On average, predicted E* values were deviated 
from the equality line by 35%. In second place, the Witczak-Lanamme model predicted E* 
values with a slight deviation from the equality line (about 4%). Finally, the E* - NN had the 
lowest deviation from the line of equality with only 1%. 


40000 
y = 1.3484x 
oe 

30000 - + a2. 
£ y = 0.9937x 
= 
= y = 0.962x 
lu 
7% 20000 - 
- 
= 
o 
o 
bee 
2 E* Witczak 

aco = E* Witczak-Lanamme 

4 E*-NN Model 
—Equality 
(6) 
0 10000 20000 30000 40000 
E* Lab, MPa 


Fig. 7. Comparison of Predictive Models. 


The accuracy of the three predictive models was also analyzed by means of goodness of fit 
parameters in arithmetic space. Table 6 shows the calculated parameters for all the models along 
with the respective criteria. The lowest coefficient of determination (R’) in arithmetic space and 
the highest standard error of the estimate/standard deviation value (Se/Sy) for the Witczak model 
confirmed its limited ability to predict E* values for mixtures in Costa Rica. A significant 
improvement in the prediction of E* values, with respect to the Witczak model was obtained 
with the use of the Witczak-Lanamme model (59% improvement in the R2 value and 29% 
reduction in the Se/Sy value). However, the best results were obtained for the E* - NN model 
with the highest R* and lowest Se/Sy values (69% improvement in the R* value and 77% 
reduction in the Se/Sy value with respect to the Witczak model). 


Table 6 
Goodness of Fit Parameters. 
Parameters Goodness of Fit (Witczak et al. 2002) 
Model R? R? adj. 2 a Criteria R? Se/Sy 
Witczak 0.592 0.589 0.372 Excellent > 0.90 < 0.35 
Witczak-Lanamme 0.935 0.934 0.262 Good 0.70 - .089 0.36 - 0.55 
E* - NN Model 0.993 0.992 0.086 Fair 0.40 - 0.69 0.56 - 0.75 
Poor 0.20 - 0.39 0.76 - 0.90 
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In summary, overestimation of E* values for Costa Rican mixtures by the Witczak I-37A model 
led to its local calibration (Witczak-Lanamme model). An additional model adequacy checking 
performed on these two models led to the construction of a new and improved model based on 
artificial neural networks (E* - NN model). This final model not only met the model adequacy 
criteria but also had the best overall goodness of fit parameters. 


7. Conclusions and recommendations 


The results of this study led the research team to the following conclusions: 


Even when a local calibration of the Witczak I-37A model was performed for 10 mixtures 
in Costa Rica, there was still room for improvement. Further investigation showed that 
high errors were still obtained from some mixtures when using the calibrated model. 

The data clearly indicated that calibration of the E* models, based on direct application of 
standard regression techniques such as OLS was not adequate since several of the 
assumptions made when using this technique were violated, rendering the estimated values 
as inefficient (variance in the model can be further improved). 

The application of artificial neural networks proved to be a most appropriate methodology 
to improve the predictability of E* values. The E* - NN model complied with the model 
adequacy criteria, had the best goodness of fit parameters and exhibited the lowest overall 
bias (69% improvement in the R* value and 77% reduction in the Se/Sy value with respect 
to the Witczak model). 

In order to further improve this prediction model for Costa Rica, future calibration and 
verification efforts are necessary; therefore, it is recommended to increase the number of 
tests performed (increase the E* database). 
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